Investigate into Invariance Properties of Item Response Theory (irt) by Two and Three Parameter Models
نویسنده
چکیده
Despite the well-known theoretical differences between item response theory (IRT) and classical test theory (CTT), research examining their empirical properties has failed to reveal consistent, demonstrable differences due to usage of samples with errors, incorrect assumptions & incorrect calculations. Dr. Natarajan (India, 1984) had proved the item invariance with his classic 20 X 76 test data and group invariance with 25 X 1000 test data. However, this research will investigate the invariance property of IRT using real live data and also find out how far is this IRT theory an enabler of accurate estimation of parameters over and above the classical test theory (CTT) properties? The objectives of the present research will be: a) to demonstrate through an illustration, the classical test theory (CTT) is a group dependent statistical analysis and bring out its limitations b) to ascertain group invariance of item parameters and item invariance of ability parameters in IRT c) to hypothesize that IRT based item parameter/ability parameters are invariant and more accurate than CTT characteristics. A large scale country wise computer based test (CBT) examinations assessment data is used for this research. The current findings indicate that in CTT, the facility value and index of difficulty are group dependent. Studies are being carried out on invariance property, the core and critical characteristic of IRT for which results are expected in next one year.
منابع مشابه
Assessing parameter invariance in item response theory’s logistic two item parameter model: A Monte Carlo investigation
Statistical properties of the ability level estimate ( ) in item response theory (IRT) were investigated through a Monte Carlo investigation, based on data generated with a four cases multifactor design. Dichotomous items and the logistic two-parameter IRT model in a one-dimensional setting have been chosen. The estimation procedure was the marginalized Bayesian item parameters estimation and E...
متن کاملInvestigating the Impact of Item Parameter Drift for Item Response Theory Models with Mixture Distributions
This study investigates the impact of item parameter drift (IPD) on parameter and ability estimation when the underlying measurement model fits a mixture distribution, thereby violating the item invariance property of unidimensional item response theory (IRT) models. An empirical study was conducted to demonstrate the occurrence of both IPD and an underlying mixture distribution using real-worl...
متن کاملCLASSICAL TEST THEORY vs. ITEM RESPONSE THEORY An evaluation of the theory test in the Swedish driving-license test
The Swedish driving-license test consists of a theory test and a practical road test. The aim of this paper is to evaluate which Item Response Theory (IRT) model among the one (1PL), two (2PL) and three (3PL) parameter logistic IRT models that is the most suitable to use when evaluating the theory test in the Swedish driving-license test. Further, to compare the chosen IRT model with the indice...
متن کاملLinear and Nonlinear Modeling of Item Position Effects
Item parameter invariance is one of the properties of item response theory (IRT) that enables computerized adaptive testing (CAT) for test administration. The possible influence of item position on test performance is one of the severe threats to the property of item parameter invariance within IRT. This study examines how different impact how the relationship between item position and item dif...
متن کاملDetermination of the Parameters of Six Multiple Choice Tests of Mashhad University of Medical Sciences (1389-90) based on Item-Response Theory (IRT)
Background: According to the industrialization of countries and development of societies, tests and methods are required to employ people in industries and organizations and make the best selection in getting workforce. Interviews, Written tests , and multiple choice tests are common methods used in employing people. Among these methods , multiple choice tests is the easiest one because of th...
متن کامل